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Jrt Abstract. Are analog models of computations more powerful than classical models of computations? From 

^H a series of recent papers, it is now clear that many realistic analog models of computations are provably 

^H equivalent to classical digital models of computations from a computability point of view. Take, for example, 

^-H the probably most realistic model of analog computation, the General Purpose Analog Computer (GPAC) 

^N| model from Claude Shannon, a model for Differential Analyzers, which are analog machines used from 1930s 
to early 1960s to solve various problems. It is now known that functions computable by Turing machines are 

L ,^' provably exactly those that are computable by GPAC. 

S.I' This paper is about next step: understanding if this equivalence also holds at the complexity level. In this paper 

V,^ we show that the realistic models of analog computation - namely the General Purpose Analog Computer 

rj^ (GPAC) - can simulate Turing machines in a computationally efficient manner. More concretely we show that, 

O modulo polynomial reductions, computations of Turing machines can be simulated by GPACs, without the 

' ' need of using more (space) resources than those used in the original Turing computation. 

^^ As we recently proved that functions computable by a GPAC in a polynomial time with similar restrictions can 

►-^ always be simulated by a Turing machine, this opens the way to, first, a proof that realistic analog models of 

|- — computations do satisfy the effective Church Turing thesis, and second to a well founded theory of complexity 

\^ for analog models of computations. 

-y-^ 1 Introduction 

O 

CNl The Church- Turing thesis is a cornerstone result in theoretical computer science. It states that any (discrete time, 

^"^ digital) computational model which captures the notion of algorithm is computationally equivalent to the Turing 

^ machine (see e.g. |19j . |23j). It also relates various aspects of models in a very surprising and strong way. 

When considering non-discrete time or non-digital models, the situation is far from being so clear. In particular, 
when considering models working over real numbers, several models are clearly not equivalent [9] . 

However, a question of interest is whether physically realistic models of computation over the real numbers 
are equivalent, or can be related. Some of the results of non-equivalence involve models, like the BSS model [S], 
[3], which are claimed not to be physically realistic |9^ (although they certainly are interesting from an algebraic 
perspective), or models which depend critically on the use of exact precision computation for obtaining super- Turing 
power, e.g. P, 0. 

Realistic models of computation over the reals clearly include the General Purpose Analog Computer (GPAC), 
an analog continuous-time model of computation and Computable Analysis. The GPAC is a mathematical model 
introduced by Shannon [21' of an earlier analog computer, the Differential Analyzer. The first general-purpose 
Differential Analyzer is generally attributed to Vannevar Bush [10] . Differential Analyzers have been used intensively 
up to the 1950's as computational machines to solve various problems from ballistic to aircraft design, before the 
era of the digital computer [18] . 

Computable analysis, based on Turing machines, can be considered as today's most used model for talking 
about computability and complexity over reals. In this approach, real numbers are encoded as sequences of discrete 
quantities and a discrete model is used to compute over these sequences. More details can be found in the books 
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PO], T7], Pl]. As this model is clearly based on classical (digital and discrete time) models like Turing machines, 
and that such models are admitted to be realistic models of today's computers, one can clearly consider such an 
approach to deal with a realistic model of computation. 

Understanding whether there could exist something similar to a Church- Turing thesis for analog models of 
computation, or whether analog models of computation could be more powerful than today's classical models of 
computation motivated us to try to relate GPAC computable functions to functions computable in the sense of 
recursive analysis. 

The paper ^ was a first step towards the objective of obtaining a version of the Church- Turing thesis for physi- 
cally feasible models over the real numbers. This paper proves that, from a comput ability perspective. Computable 
Analysis and the GPAC are equivalent: GPAC computable functions are computable and, conversely, functions 
computable by Turing machines or in the computable analysis sense can be computed by GPACs. 

However this is about computahility, and not complexity. This proves that one can not solve more problems 
using analog models. But this leaves open the intriguing question whether one could solve some problems faster 
using analog models of computations (see e.g. what happens for quantum models of computations...). In other 
words, the question of whether the above models are equivalent at a computational complexity level remained open. 
Part of the difficulty stems from finding an appropriate notion of complexity (see e.g. [22], [2]) for analog models of 
computations. 

In the present paper we study both the GPAC and Computable Analysis at a complexity level. In particular, 
we introduce measures for space complexity and show that, using these measures, both models are equivalent, even 
at a computational complexity level. Since we already have shown in our previous paper 7 that Turing machines 
can simulate efficiently GPACs, we will prove in this paper the missing link: GPACs can simulate Turing machines 
in an efficient manner. 

More concretely we show that, modulo polynomial reductions, computations of Turing machines can be simulated 
by GPACs, without the need of using more (space) resources than those used in the original Turing computation. 

In a schematic view, here is the situation that we reach, when relating the constructions presented in this paper 
with already known results, where PIVP stands for Polynomial Initial Value Problems, known to be equivalent to 



GPACs (see [H] and Section 2.2 1 



Turing Machine 

Time: T 
Space: S 
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PIVP/GPAC 

Time: T 
Space: poly{S, T) 
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Turing Machine 

Time: poly{S, T) 
Space: poly{S,T) 



We believe that these results open the way to state that realistic analog models do satisfy the classical Church- 
Turing thesis in a provable way, both at the coniputability and complexity level, hence when talking both about 
Church- Turing thesis and Church- Turing effective thesis. 

We believe that this opens the way to a well founded complexity theory for analog models of computations and 
for continuous dynamical systems. 

Notice that it has been observed in several papers that, since continuous time systems might undergo arbitrary 
space and time contractions, Turing machines, as well as even accelerating Turing machineaj |14| . [13] . |12j or even 
oracle Turing machines, can actually be simulated in an arbitrary short time by ordinary differential equations in 
an arbitrary short time or space. This is sometimes also called Zeno's phenomenon: an infinite number of discrete 
transitions may happen in a finite time: see e.g. [S]. 

Such constructions or facts have been deep obstacles to various attempts to build a well founded complexity 
theory for analog models of computations: see ^8j for discussions. 

One way to interpret our results is then the following: all these time and space phenomena, or Zeno's phenomena 
do not hold (or, at least, they do not hold in a problematic manner) for ordinary differential equations corresponding 



Similar possibilities of simulating accelerating Turing machines through quantum mechanics are discussed in |11] . 



to GPACs, that is to say for realistic models. This has ah-eady been stated at various places. The novelty is first a 
statement of what "realistic" includes, and second a formal proof of it. 

2 GPAC 

2.1 Preliminaries 

Throughout the paper we will use the following notation: ||(a;i, . . . ,2:n)|loo = maxi^^^n \xi\ and ||(a;i, . . . ,a;„)|| = 
-\/|xip + • • • + |a;„p. We will also use the following shortcuts 'Ki{xi,. . . , Xk) — Xi, int(a;) — [xj , frac(a;) — x ~ [xj , 
int„(a;) ~ min(n, int(a;)), frac„(a;) = x — int„(a;), and 



In this section, we consider the following ODE 



id if n = 

j["-il otherwise 



y{h)^ 2/0 ^ ^ 



where p : M'' ^- M'' is a vector of polynomials. This is motivated by the fact that this is known [T5] that a function 
is generable by a GPAC iff it is a component of the solution to the initial- value problem (fTl) . 

If p : R'* — >• R a is polynomial, we write p{Xi, . . . , Xd) = X^iai^fc o,aX°' where k is degree of pi that we denote 
as d°pi. We also take, as usual, \a\ = ai + • • • + ad- We also write SP — X^ui^fc ha| If p : K'' — J> K'^ is a vector 
of polynomials, we write d°p = max(d°pi, . . . , d°pd) and Sp = max(Z'pi, . . . , Spd)- When it is not ambiguous, for 
any constant A G M wc identify A with the constant function (xi, . . . , Xk) i— > A. 

2.2 Basic properties 

It is known [T(? that a function is generable by a GPAC iff it is a component of the solution to the initial-value 
problem (IT]): formally, a function / : M -^- M is generable by a GPAC if it belongs to the following class GPAC(/): 

Definition 1. Let I C M. be an open interval and / : / ^ M. We say that f E GPAC(/) if there exists d E N, a 
vector of polynomials p, t^ E I and j/g G I^'* such that Vi E I, f{t) = yi{t), where y : / — > M is the unique solution 
over I of 

y =p(?y) 
^y{to)= yo 

We want to talk about a subclass of GPAC generable functions, that permits to talk about complexity. This 
leads to the following definition. 

Definition 2. Let I C R be an open interval, /, 5 : / ^- M. We say that f E GSPACE (J, g) if there exists d E N, 
a vector of polynomials p, t^ E I and j/q E W^ such that V< E I, f{t) — yi{t) and \\y{t)\\^ ^ 5(^)7 where y : / — > M is 
the unique solution over I of 

y ^p{y) 
^yito)= yo 

Let f : I -^ R'^ . We say that f E GSPACE (/, g) if^i, (/, : / ^ M) e GSPACE (/, g). 

The following can be proved (non-trivial missing proofs are in appendix). 
Lemma 1. Let /, J C M, / g GSPACE (/, Sf) and g E GSPACE (J, Sg). Then: 

- f + 9,f-9(^ GSPACE (/ n J, s/ + Sg) 

- fg E GSPACE (J n J, max(s/, Sg,SfSg)) 



(Xi,.. .,Xd) l-> {Xi^,...,XiJ 



e -> M2 



- /oge GSPACE(J,max(sg,s/osg)) if g{J) C I 

Definition 3. Let / C M'' fee open set and j, Sf : I ^ R. We say that f G GSPACE (J, s/) i/ 

VJ C M open interval ,\/{g : J -^ M'') G GSPACE (J, Sg) smc/i i/iat g(J) C /, fog e GSPACE (J, ma,x{sg, Sf o Sg)) 

Remark 1. In the special case of / C M, Definition [3] matches Definition [2] because of Lemma [l] 

Lemma 2. Let l,J QW^ he open sets, {f : L ^ M") e GSPACE (/,s/) and (g : J ^ M™) e GSPACE (J, Sg). 
Then: 

- f + gJ-g(^ GSPACE (/ n J, s/ + Sg) ifn^m 

— f g ^ GSPACE {I n J,raa:ic{sf,Sg,SfSg)) if n = m 

^ f ° g & GSPACE (J, max(sg, Sf o Sg)) if m = d and g{J) C / 

Definition 4. Let d, e e N and {ii, . . . ,ie) £ [l, d]'^ we define 

TTdiil,- ■ ■ ,ie) ■ 
Example 1. 

714(1, 3) : < , ^ . X 

[(Xi,X2,X3,Xi) ^ (Xi,X3) 

Lemma 3. For any d,e E N such that e ^ d, for any {ii, . . . ,ie) G |1, dj'^ and for any I C M'', 

^d(ii,...,ie)e GSPACE (/,0) 

Lemma 4. Let L C W and J C R" be open sets, (/ : / ^ M'*) e GSPACE (/,s/) and p : J ^ I a vector of 
polynomials. Then / o p g GSPACE (J, Sfop). 

Lemma 5. sin, tanh e GSPACE (M, 1) 

2.3 Main result 

The main result of this paper is the following (poly(S'(e) + T) stands for polynomial in ^(e) + T)): 

Theorem 1. Let M he a Turing Machine. Then there exists a vector of polynomials p such that, for any input e 
and time T, the solution y of ^ with initial condition y{0) =< (j){e),ijj{S{e),T), ... > (cj) and ip define a simple 
encoding scheme), where S{e) is the space used hy M on input e, satisfies the following properties: 

— for any integer time t ^ T, y{t) fully and unamhiguously describes the state of M on input e at step t 

- for anyOi^ti: T, \\y{t)\\^ sC poly(5(e) + T) 

3 Turing Machines Simulations 

In this section we explain how to simulate a Turing Machine with a GPAC. We would like to simulate a Turing 
Machine with a polynomially bounded GPAC. As a matter of comparison, it is already known how to simulation 
any Turing Machine for an arbitrary number of steps using an exponentially bounded GPAC J15j . 
Our simulations are different from the already known ones in several ways: 

— The simulation will only be valid for a certain number of steps: this will be sufficient as we want to talk about 
(time) complexity, and hence we mostly have a bound on the time of computation. 

~ The values of the components of the system will be polynomially bounded; 



3.1 Helper functions 

Our simulation will be performed on a real domain and may be subjected to (small) errors. Thus, to simulate a 
Turing machine over a large number os steps, we need tools which allow us to keep errors under control. In this section 
we present functions which are specially designed to fulfill this objective. We call these function helper functions. 
Notice that since functions generated by GPACs are analytic, all helper functions are required to be analytic. As 
a building block for creating more complex functions, it will be useful to obtain analytic approximations of the 
functions int(a;) and frac(a;). Notice that we are only concerned about nonnegative numbers so there is no need 
to discuss the definition of these functions on negative numbers. A graphical representation of the various helper 
functions we will introduce in this section can be found on Figure [l] Figure [3] and Figure HI 

Definition 5. For any x, y, A G M define ^(x, y, A) — tauh{xyX) 

The following can be proved (see appendix). 



Lemma 6. For any x e M and X> 0,y ^ 1, 

Furthermore if \x\ ^ A^^ then 
and^e GSPACE(m3,1). 



|sgn(x)-^(x,2/,A)|<l/2 
\sgn{x)-^{x,y,\)\ < e~y 



^(x,l,4) C(^,20,' 



cri(x,20, 100) 



Fig. 1. Graphical representation of ^ and g\ 

Definition 6. For any x,y.\ £ M, define (Ti(a;, y, A) = 2 '^' 

Corollary 1. For any a; e M and y > 0, A > 2, 

|inti(a:)-ai(x,y,A)| s^ 1/2 

Furthermore if \1 ~ x\'^ \~^ then 

I inti (x) - CTi (x, y, A) I < e~^ 

andai G GSPACE (M^, l) . 

Definition 7. For any p G N, x, y, A G M, define <7p{x, y, A) — X]j=o '''1(2^ ~ *j ?/ + li^Pi ^) 
Lemma 7. For any p G N, a; G M and y > 0, A > 2, 

|intp(a;)-crp(a;,y,A)| ^ 1/2 + e"^ 
Furthermore if x < 1 — A^^ or x > p + A^^ or d{x,N) > A^^ then 

I intp(a;) - ap{x, y, A)| < e"*' 
and ape GSPACE (M^^ p) . 



Finally, we build a square wave like function which we be useful later on. 
Definition 8. For any teR, and \ > 0, define e{t,X) = e-A(i-sin(277t))" 
Lemma 8. For any A > 0, p{-,X) is a positive and 1-periodic function bounded by 1, furthermore 

Vte[l/2,l],|0(t,A)Ke-^ 
(eX)-i 

and 9 e GSPACE (M x M^, {t, A) ^ max(l, A)) . 

Polynomial interpolation In order to implement the transition function of the Turing Machine, we will use 
polynomial interpolation (Lagrange interpolation). But since our simulation may have to deal with some amount 
of error in inputs, we have to investigate how this error propagates through the interpolating polynomial. 

Lemma 9. Let n eN, x,y £ W\ K > be such that \\x\\^, ||?;||^ < K, then 

n n n 

Definition 9 (Lagrange polynomial). Let d ^N and / : G — > M where G is a finite subset ofR^, we define 

Xi — Vi 

We recall that by definition, for all x G G, Lf{x) = f{x) so the interesting part is to know what happen for 
values of x not in G but close to G, that is to relate Lf{x) — Lf{x) with x — x. 

Lemma 10. Let d E N, K > and / : G — > M, where G is a finite subset ofM.'^. Then 

yx,ze[-K,Kf,\Lf{x)~Lf{z)\i^A\\x-z\\^ and Lf e GSPACF. {[-K, K]"^, B) 

where 

d 

6= min min Ix,- — a;'| F = max I f(a;)| A/ = if + max ||x||„ 
x^x'eG 1=1 xeG xeG 

j^j.di\G\-l)-l /^y-\ rf(|G|-l) 

I 



A-\G\F[- di\G\-l) B=\G\Fl^\ 



3.2 Turing Machine 

Assumptions Let 7W — {Q, IJ,b,S,qo,F) be a Turing Machine which will be fixed for the whole simulation. 
Without loss of generality we assume that: 

- When the machine reaches a final state, it stays in this state: so F is useless in what follows. 

- g = io,TO-ii 

- Z" == |0, fc - 2] and fe = 

- d : Q X S ^ Q X S X {L, R}, and we identify {L, R} with {0, 1} (L = and R = 1). 

Consider a configuration c — {x,a,y) of the machine as described in Figure^ We could encode it as a triple of 
integers as done in [15] (e.g. if a;o, a;i, . . . are the digits of x in base fc, encode x as the number xq + Xik + X2k'^ + ■ ■ ■ + 
Xnk"), but this encoding is not suitable for our needs. We instead define the rational encoding [c] of c as follows. 



Definition 10. Let c — {x,s,y,q) be a configuration of Ai, we define the rational encoding [c] of c as [c] 
{0.x, s,0.y, q) where: 



0.x ^ xok + xik + ■ ■ ■ + Xnk 



e 



if X — xq + xik + • • • + a;„A;" G N. 



The following lemma explains the consequences on the rational encoding of configurations of the assumptions 
we made for A4. 

Lemma 11. Let c be a reachable configuration of M and [c] = {0.x,a,0.y,q), then 0.x £ [0, ^^] and similarly for 

y- 
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head 



Fig. 2. Turing Machine configuration 



Simulation by iteration The first step towards a simulation of a Turing Machine M using a GPAC is to 
simulate the transition function of Ai with a GPAC-computable function step^ . The next step is to iterate the 
function step^ with a GPAC. Instead of considering configurations c of the machine, we will consider its rational 
configurations [c] and use the helper functions defined previously. Theoretically, because [c] is rational, we just need 
that the simulation works over rationals. But, in practice, because errors are allowed on inputs, the function step^ 
has to simulate the transition function of Al in a manner which tolerates small errors on the input. We recall that 
i5 is the transition function of the Ai and we write 5i the i*'* component of d. 

Definition 11. We define: 



step^ 
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K* 


— y 




fx\ 


[choose 
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t-^ 


choos 




y 




choose 




\<ij 




^ 



y+Ls (q,s) 



frac(/ca;), 
choose [int(fcx), int(fc?;)] 



y+Ls^(q,s) 
k ■ 

Lsi {q, s) 



irac{ky) 



J 



where 



choose[a, b] ~ {I — Ls^ (q, s))a + Ls^ {q, s)b 
The function step^ simulates the transition function of the Turing Machine jM, as shown in the following result. 
Lemma 12. Let co,ci, . . . be the sequence of configurations of A4 starting from cq. Then 

VneN,[c„]=step_;vi'"'(N) 

Now we want to extend the function step^ to work not only on rationals coding configuration but also on 
reals close to configurations, in a way which tolerates small errors on the input. That is we want to build a robust 



approximation of step^. We already have some results on L thanks to Lemma 10 We also have some results on 
int(-) and frac(-). However, we need to pay attention to the case of nearly empty tapes. 

Indeed, consider the case where, say, the tape on the left of the head contains a single character s. Then 
X = O.s = sk~^ . Now assume that the head moves left. After the move we should be in the configuration (0, s, _, _). 
Looking at the definition of step^, one sees that this works because int(fca;) = int(s) = s. However if one perturbes 
a little bit x to x — e, then mt{k{x — e)) = s — 1. To overcome this difficulty, we will use to our advantage the 



choice of k and its main consequence. Lemma 11 Indeed, if we shift kx by a small amount, we can allow a small 
perturbation. Since integers are the worst case scenario for our approximation of int(-), we center the unreachable 
range for the tape on it, thus considering int(fca; + ^). The same applies to frac(fca;) with a caveat: we will use 
kx — int(fca:: + ^) instead. 



Definition 12. Define: 



step^ (t, A) : < 



s 

y 



^ 



choose 

choc 

choose 



frac(A:a;) , ^^ ''''' ,q,s 



choose [int(fcx), int(fcy), q, s] 



i<5i(9,s) 



choose[a, b, q, s] = (1 — Lg^ (q, s))a + Ls^ (g, s)b 

1 



where 



mt(a;) = ct^ ( ^+ ^''^'^ 

frac(a;) = x — int(x) 
We now show that step^ is a robust version of step^. We first begin with a lemma about function choose. 
Lemma 13. There exists ^3 > and B^ > such that Vq, q, s, s, a, b,a,b Cz M, if 

||(a,5)||^<M and qeQ,seS and ||(g, s) - (g, s)||^ < 1 

then 

|choose[a,&,g, s] - choose[a, 6, g, s]| s^ \\{a,b) - {a,b)\\^ + 2MA3\\{q,s) - {q,s)\\^ 

Furthermore, choose e GSPACE (M^ x [-m, m] x [-k, k], (a, b, q, s) h^ (1 + B3){a + b)) . 

Lemma 14. There exists Ai, A2, A3, Bi, B2, B^ > such that for any r, A > 0, any valid rational configuration 
c = {x, s, y, q) G M^ and any c = {x, s, y, q) G W^ , if 



(^,2/)-(^,y)IL^^-^ 



and ||(g,s)- (g,s)||^ ^ 1 



then 



/orpG{l,3} I step^(c)p - step^(r, A)(c)p| sg k\\{x,y) - {x,y\\^ + (1 + 2^3) (e'" + ^\\{q, s) - {g, s)\\J 
|step_^(c)2-stepA^(T, A)(c)2| ^ 2A3k\\{q,s)- {q,s)\\^+e ^ 
|step^(c)4-step^(T, A)(c)4| s^ Ai\\{q,s) - {q,s)\\^ 

Furthermore, 

step^ G GSPACE ((M;)2 X [-1,1] X [-m,m] x [-1,1] x [-fc, fc], Bi + (1 + B3)(2fc + 1 + Bafc"^)) 

Proof. To apply Lemma [TS} we need two kinds of results: bounds on the difference between the argument of choose 
and bounds on the argument themselves. Let Ai and A2 be the constants coming from Lemma [TO] applied to Si and 
62 (because Q and E are finite and thus bounded and (g, s) is bounded by hypothesis). To improve readability, we 
write A= ||(g,s)- (g,s)||^. 

— We first show that | int(fcx) — int(fca;)| ^ e^"^: since c is a valid configuration, x = O.uz where u G |0, fc — 2] and 
z G [0, ^^] by Lemma 11 By hypothesis, |x — a;| ^ 2S2 ~ sDi ^° 1^^ ~ ^^1 ^ Jii ~ J- Notice that kx — u.z thus 
kx G [u,'u+^^] and as a consequence kx G [u— ^ + \,u+^^ + ^ — j\. Finally, kx+i^ G [u+^, u+1 — ^]. By 
Lemma 7I \crk{kxA-i^, A,t)— intfc(A:x+^)| ^ e^'^. But kx+^ G [u+^tU+1—^] so viitk{kx+i^) = int(fca;) = il. 

— It is then easy to see that | frac(fcx) — frac(fca;)| ^ k\x — a;| + e^^. 

— ByLemmafTol \Ls^{q,s) - Ls^{q,s)\ ^ A2A. 



Thus, 



x+Ls,^{q,s) x+Ls^(q,s) 



^ k 



k k 

As a consequence, |int(A:a;)| ^ fc — 2 + e^"^ since |int(fca;)| ^ | mt{kx)\ + \ int(fc.T) — int(A;a;)| and | int(fca;)| ^ k ~2 



Similarly, |frac(/ca:)| ^ ^^ + k\x — x\ + e ^^1 + e ^ since | frac(fcx)| ^ ^^ by Lemma 11 



- Also, \Ls^iq,s)\ s^ k-2 + A2A since \Ls^{q,s)\ ^ fc - 2. 



Finally, 



x+Ls {q,s) 



k 



fc-i I 1 



^ \x\ + \x-x\ + k-2+A2A ^ -fc — ^2 



-k-2+AoA 



< 1 + ^ since Z\ < 1. 



fc "* fc 

Now applying Lemma [13] four times gives the result. We write the computation for the two interesting cases: 

Ai 



I step;^ (c) 1 - step^ (r. A) (c) 1 1 < 



k 



2A3 max 



1 + e-M 



k 



< fc|x - xl + e-" + ^ + 2.43 A + e-" + ^ 1 Z\ 
^ k\x - x| + (1 + 2A3) (e-^ + ^A 



|step^(c)2-step^(T,A)(c)2| ^ e"^ + 2A3(fc - 2 + e ^)A 

s^ e"^ + 2^3fcZ\ 

We summarize the previous lemma into the following simpler form. 

Corollary 2. For any t, A > 0, any valid rational configuration c = {x, s, y, q) € M"* and any c = {x, s, y, q) G M^, 

\\{x,y)-{x,y)\\^^^^-— and ||(g, s) - (g, s)||^ < 1 



then 

Furthermore, 



2fc2 fcA 
||step^(c)-ite^^(r,A)(c)||^ s^ 0(l)(e-^ + ||c - c||^) 

step^ G GSPACE((M;)2 X [-1,1] X [-m,m] x [-1,1] x [-fc,fc],0(l)) 



3.3 Iterating functions with differential equations 

We will use a special kind of differential equations to perform the iteration of a map with differential equations. In 
essence, it relies on the following core differential equation 



x{t) = A(j){t){g - x{t)) 



(Reach) 



We will see that with proper assumptions, the solution converges very quickly to the goal g. However, (Reach) is a 



simplistic idealization of the system so we need to consider a perturbed equation where the goal is not a constant 
anymore and the derivative is subject to small errors 



x{t) ^ Mmm - <t)) + E{t) 



(ReachPerturbed) 



We will again see that, with proper assumptions, the solution converges quickly to the goal within a small error. 
Finally we will see how to build a differential equation which iterates a map within a small error. 



assume is a C^ function 



We first focus on (Reach) and then (ReachPerturbed) to show that they behave as expected. In this section we 



Lemma 15. Let x he a solution of (Reach), letT,X>0 and assume A ^ ^^ then\x{T) — g\ ^ I5 — a;(0)|e ^. 



Proof. Check that x{t) = g + (a;(0) — g)e "^■'0 't'W'^^ is the unique solution of (Reach), which gives the result 
immediately. 



Lemma 16. Let T, A > and let x he the solution of ([ReachPerturbed ) with initial condition x{Q) — Xq. Assume 



\g{t) -g\^r],A^ 



!o 4>iu)d.u 



and Elt) = for t G [0, T] . The 

\xiT)-g\^Tj{l + e'^) + \xo-g\e- 



Proof. Let x~^, x be the respective solutions of i = A(f){t){g ztrj — x{t)) with initial condition a::(0) = a;o. We will 
show that Vt G [0,T],x-{t) ^ cc(i) < x+{t). 

Consider f{t,u) = A(j){t){g{t) ~ u) + E{t) and f^lt.u) = A<j){t){g±T]- u). Then a; satisfies x{t) = f{t,x{t)) and 
a;^ satisfy x'^it) = f^{t,x{t)). It is easy to see that for any t G [0,T] and any m G M, f^{t,u) ^ f{t,u) ^ f^{t,u). 
Thus, by a classical result of differential inequations, x~{t) ^ x{t) ^ x+fi) for any i G [0,r 



We prove that |x±(T) - g\ ^ 77(1 



.-An 



xq — g\e using Lemma 15 and the fact that x {t) ^ x{t) ^ x^{t). 



We can now define a system that simulates the iteration of a function using a system based on ( ReachPerturbed ) 



Definition 13. Let deN, F 



l'^, A ^ 1,/i ^ 0, we define 

A^10{X + fif 

B= 4(A + /i) 
z,{t)= Ae{t,B){F,{u{t)) - z,{t)) 
u^{t)= A6{t - 1/2, B){z,{t) - u^{t)) 



(Iterate) 



Tiieorem 2. Let d G N, i^ : M'^ ^ M'^, A ^ 1, ^ ^ 0, cq G M''. Assume z, u are solutions to ( |Iterate[ ) and Zef zii^ 
and M ^ 1 6e smc/i t/iai 

VfcGN,Ve>0,Va;G] -£,£['*, F^^+^\cq) - F (f^^\cq) + x) ^ AF{e) 

V / 00 

Vt ;^ 0, ||u(i)||^, ||z(t)IL, \\F{u{t))\\^ < M = e'^ 



id consider 



eo = ||w(0)-co||^ 
efc+i=(l + 3e-^)Z\f(efc+2e-^) 



5e- 



Then 



V/cgN, 



u(fc)-FW(co) 



< efc 



Furth 



ermore, i 



ifF£ GSPACE {[-M, M]^ sp) then u G GSPACE ( (M;)^ , (A, //, t) ^ max(l, 4(A + ^l), sf{M)) 



Proof. First wc show that AMe " ^ e 



-A. 



ylM " 10(A + /i)2 
Second we show that A^ {X + ^)Tr{eB)i: 

A _ 10(A + ^)i 



^ 1 because A + /i ^ 1 by the study of 



o3x 



10x2 



10 



1 — . M /. ^^ — VT7T ^ 1 because A + w ^ 1 

(A + M)vr(eB)i 7r(4e)i/4 -^ 7r(4e)i/4 - ^- 

We prove the result by induction on k. There is nothing to prove for fc = since F''^'{co) = cq. Now let fc G N 
and assume w(A:) — -F['^1(co) ^ Sk- We will work in two steps: first we consider the evolution of u and z on 

[fc. A: + 1/2] and then [A: + 1/2, fc + 1] . 

- Notice that for any i G [fc,A: + l/2], by Lemma [s) |6'(t- 1/2, 5)| < e~^. Thus \uiit)\ sC Ae-^2M ^ 2e-^. Hence 
\ui{t) - Ui{k)\ s^ 2e-^. By induction hypothesis, \\u{k) - i^W(co)||^ < £fe thus \\u{t) ~ F^''\co)\\^ < efc + 2e"^. 

Finally, by hypothesis, yF(u(i)) - i^'^^'+'kco)!!^ < ^^(^^^ + "^^'^T 



Now thanks for Lemma 



J^^ ' d{t, B)dt ^ ^"^l " ^ ^. Thus the hypothesis of Lemma 



16 



are met and we 



have ||z(fc + l/2) -F['="(co)|| ^ (1 + e-^-^)Z\F(£fe + 26"^) + 2Me-^-^ ^ (1 + e-^)Z\F(£fe + 2e-^) + 26"^. 



Similarly, for any t e [k + 1/2, k + 1], by Lemmals] \\z{t) -z(fc + l/2)||^ s^ 2e-^ thus \\z{t) - F^''^^\cq)\\^ < 



(1 



)AF{ek+2e-^)+4:e 



-A 



Now apply Lemma [16| as before to u and we get that 

i{k + 1) - Fl'^+il (co) s^ (1 + e-^) ((1 + e-^)AF{sk + 2e-^) + 2e-^) + 2e 

OO 

< (1 + 3e"^)ziF(£fc + 2e-^) + 5e"^ 

3.4 Turing Machine simulation with differential equations 

In this section, we will use results of both Section [3^ and Section [33] to simulate Turing Machines with differential 



equations. Indeed, in Section 3.2 we showed that we could simulate a Turing Machine by iterating a robust real 



map, and in Section 3.3 we showed how to efficiently iterate a robust map with differential equations. Now we just 
have to connect these results 

Lemma 17. Let a > 1 and b ^ 0, assume u £ M^ satisfies u„+i ^ au„ + b, forn ^ 0. Then 

, a" - 1 

Un ^ a Uo + , 71 ^ 

a — 1 



Theorem 3. Let Ai be a Turing Machine as in Section 3.2, then there is Jm G GSPACE I (K^) , Sj ) such that 
for any sequence Co,Ci, . . . , of configurations of Ai starting from the initial configuration Cq, 

V^,T e M;,Vn < T, IIM - fM{S,T,n)\\^ ^ e"^ 

and 

V5, T e M;, Vn sC T, Su{,S, T, n) = 0{poly{S, T)) 

Proof. Let r > (to be fixed later) and apply Theorem [2] to F = step^ (r, 4fc) . By Corollary [2] 3Ki , K2 such that 

AF{e) ^ Ki{e-^ + e) 

and 

yxeA= [-1, 1] X [-m, m] x [-1, 1] x [-k, fc], \\F(x)\\^ ^ K2 

Let M = K2 + 1 . The recurrence relation of e 



eo = ||m(0)-co|U 
efc+i= (1 + ?,e'^)AF{ek + 2e-^) 



5e- 



now simplifies to (using that e ^ ^ 1) 

£fc+i ^ (1 + 3e-^)i^i(e-" + efe + 2e-^) + Se"^ 

< Xi(l + 3e"^)efe + 2i^i(l + 3e"^)e-^ + Se"^ 
^ Xi(l + 3e-^) efc + (8i^i + 5)6"^ 

a b 



Now apply Lemma [T7| to get an explicit expression 



e„ < a"uo + fe 



a"-l 
a- 1 



If we take as initial condition the exact rational configuration [co], we immediately get that uq = 0. Let K^ = AKi, 
then a ^ K3. Pick A = 5 + Tlog(iC3) + log(8i^i + 5). Then St ^ e'^. 

We check with Theorem [2] that \\u{t)\\^, ll^(i)lloo < M for t < T since Et ^ 1- 



Finally, u e GSPACE (M;)^ (A, ^i,*) ^ max(l,4(A + /i),Si.(Af)) and s„ == 0{poly{S,T)). 
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A Proof of Lemma [T] 

Proof. We first consider the case of / ± 5 and fg. Without loss of generality we can assume that Big E K = I D J. 
Then / and g can be taken as components of the solution of two PIVP with the initial conditions sharing the same 
time to 

y =p{y) f z =q{z) U{t)=yi{t) 

,2/(^0)= yo \z(io)= zo \g{t)= zi{t) 



Then / ± g and fg are a components of the solution of the following two PIVPs 

y ^p{y) 



y ^p{y) 
y{to)^ 2/0 

z = p{z) 
z{to)= Zq 

u ^Pi{y)±qi{z) 



y{to)= 2/0 

z = p{z) 
ii ^pi{y)zi 



2/191(2) 



It follows pretty obviously that Sf + Sg and max(s/, Sg, SfSg) are natural bounds on the variables of the system. 

Now consider the case oi f o g: assume that there are tQ,zo such that / and g can be taken as components of 
the solution of two PIVP with the initial conditions ii = g{to) for the second one 

2/ =P(2/) f i =q{z) r/(t)=2/i(i) 

^y{ti)=I{ti) \z{to)=z,, \.9(i)=zi(t) 

Now consider u{t) = y{g{t)). It is easy to see that u(t) — g{t)y{g{t)), so one can conclude that f o g is a, last 
component of the solution to the system 

z = q{z) 

z{to)^ Zq 
ii ^p{u)qi{z) 

,'"(io)=/(zo) 

The bound on the components of the system follows directly. 



B Proof of Lemma [3] 

Proof. Let J be an open interval, let {g : J ^ M"*) G GSPACE (J, Sg) such that g{J) C /. Then TTd{ii, . . . ,ie) ° g 
{gi^ , . . . ,gi^) e GSPACE (/, Sg). This concludes the proof since Sg = max(sg, o Sg). 



C Proof of Lemma |6] 

Proof. Since sgn(-) and £^{-,y,X) are odd functions, we can assume that x ^ A"""^. A simple calculus shows that 
0^1 — tanh(a;) ^ e~* for i > 1, thus if x ^ A~^, xyX ^ y ^ 1 which gives the result. 
The last result is a direct consequence of Lemma |4] and Lemma [5J 

D Proof of Corollary [l] 

Proof. The first part of the result is a direct consequence of LemmalGJand the fact that inti(a:) = sgn(x— l)/2 + l/2. 
Let p(X) = i±^ and q{X, Y, Z) = {X - 1,Y, Z) Then p e GSPACE (E, p) . Furthermore, cti = p o ^ o q. Thus by 
Lemma |4J C » 9 S GSPACE (K^ l) and by Lemma [2J cti e GSPACE (K3^niax(l,po 1)). The results follows since 
po 1 = 1. 



E Proof of Lemma [7] 

Proof. Let a; e M. In all cases we apply Corollary [T] multiples times. 

- If a; < 1- A^i then for all 0< i <p-l, \cri{x ~ i,y + \np,\)\ s^ e^^'-'^P = ^-i. Thus |crp(x, y, A)| s^ e'V. 

- If a; >p + A"i then for aUO< i^p-1, |1 - cri(a; - i, y + Inp, A)| ^ ^. Thus \p - ap{x,y,\)\ < e'V . 

- Ifd(a;,N) ^ A^^ then for all sC i ^p-1, | inti(a:;-i)-cri(a;-i,2/+lnp, A)| sC ^^. Thus \inip{x)-lap{x,y,X)\ < 
e^^ because intp(x) — X^iLo iiiti(a; — i). 

- Otherwise, there exists ^ z ^ p— 1 s.t |p — a;| ^ A^^. Then for all j 7^ i, | inti(x — j)— cri(x — j, j/ + lnp, A)| ^ - — 
and I inti(a; — i) — ai(x — i,y + Inp, A)| ^ 1/2. Thus | intp(a;) — l(Tp(x, ?/, A)| ^ 1/2 + e^^. 

Finally, Cp G GSPACE (iR'^jp) follows from Corollary 111 by applying p — 1 times Lemma I2I 
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Fig. 4. Graphical representation of i 



Fig. 3. Graphical representation of ap 



F Proof of Lemma I 



Proof. It is trivial to see that 6 is positive and 1-periodic. Furthermore, if t e [1/2,1], then 27rt e [tt, 27r], thus 

sin(27rt) ^ 0, so finally — A(l — sm(27ri))^ ^ —A which gives the result. 

1 1 

Now fix A > 0. It is easily seen that J^ 9{t, X)dt — 2 J^ 9{t, \)dt so we can restrict our analysis to i e [0, 1/4]. 

Fix 1 > a > and set / = {f G [0,1/4] |6'(i, A) ^ a}. Since 0{-,X) is a non-decreasing function on [0,1/4] and 

6'(0, A) — e^^ and 0(1/4:, A) = 1, / is of the form / = [1/4 — x, 1/4]. We are now looking for a lower bound on x 

In a 



e{t, A) > a <^ (1 - sin(27rt))^ s^ 



-A 



^ 1 - sin(27rt) sC 



ln( 



Since t S [0, 1/4], ^ sin(27ri) ^ 1. Thus arcsin(sin(27ri)) — 27rt and arcsin is an increasing function 



<=> 27ri ^ arcsin 1 — 



ln( 



Yet yx > 0, arcsin(l - a;) s$ f - V^x 






1 1 / /Ina 



Thus 



e{t,X)dt^ —\l2\ 



2tt 



-A 



=hia) 



We are looking for the maximuni of h over [0, 1] so we analyze the derivative of h 

h'{a)=Q<=^a = e-^'^ <=, [0,1] 



/A^TT V 4 y 



which yields 
Therefore 



e{t,\)dt';^h{e-^/^) 



(eA)-V4 
27r 



Finally, it easily seen that (i i-^- (1 - sin(27ri))^) e GSPACE (M, 1) by Lemmajs] Lemma|4]and Lemma[2] Then, 
one shows that {{t, A) \-^ -A(l - sin(27ri))2) g GSPACE (M x M+, (t, A) i-^ max(l. A)). And finally, compose with 
exp to get the result. 



G Proof of Lemma [9] 

Proof. We prove it by induction on n. If n = 1, the result is trivial. If n ^ 1, one can use the induction hypothesis 
and write: 



n+l n+1 

n ^ n y-^ 



n n 



{xn+i - yn+i) Yl Xi + 2/„+i H 2;,, - J]^ yi 



'^i=i i=i 



< \xn+i - y„+i|if" + KK''-^ Y. i^» - y-\ 



H Proof of Lemma 

Proof. Let x, z £ [~K, K]"^, let S = niin^j^^'eG ^^i=i \^i ~ ^'ili P = inaxa;gG |/(a;)| and M — K + uiaxxec I 
Then using Lemma [9J 



|L^.(a:)-L;(z)K^|/(x)| 



xGG 



d d 

Xi yi I I I I 2:^ tji 



nn 



i^iyeG'^* ^' 4=1 aGG^* y^ 



y^x 



nn 



€ 



Ei/(^ 



M 



xeG 



.,.,., f) 



d(|G|-l)-l d 



EE 



i=l ySG 
y^x 



Xi Zi 



d(|G|-l)-l 



d{\G\-l) 



^i Hi 

Ik-^lloo 



And using trivial inequalities: 



ii/(^)KE 1/(^)1 nn 



xeG 



i=lyeG 
y^x 



Xi yi 



Xi yi 



€ 



E^nn 



M 



seG i=lyeG 
y^x 



d(|G|-l) 



I Proof of Lemma [TT] 

Proof. Without loss of generality we prove it only for x. Since we took S = JO, A; — 2], Vi G N, ^ x^ ^ k — 2, which 
gives the result because: 

n n n , _, 

< ^Ofc-'-i < 0.x = ^x.fe-'-i < ^(fc - 2)k-'-^ 5$ — — 

i=0 -8=0 i=0 

J Proof of Lemma [131 

Proof. The constants A^ and B^ comes from Lemma [TO] applied to S^ since Q and S are finite thus bounded and 
(g, s) is close to (g, s) thus bounded too. Regrouping terms and applying a gross majoration, plus the fact that 
q € Q and s £ S, we obtain Ls^{q, s) G {0, 1}. 

I choose[a, 6, g, s] - choose[a, 5, g, s]| = \{a - a)(l - Ls^iq.s)) + (b ~ a){Ls^{q,s) ~ Ls.:^{q,s)) + {b ~ b)Ls^{q,s)\ 

< \a~a\\l~ Ls.^{q,s)\ + \b ~ d\\Ls^{q,s) ~ Ls^{q,s)\ + \b ~b\\Ls^{q, s)\ 
^ max(|a -a\,\b^ b\) + 2Af AglKg, s) ~ {q, s)\\^ 

< \\{a,b) - {aM^+2MA3\\{q,s) - (g, s)||^ 



